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Abstract 

We give the first deterministic fully polynomial-time approximation scheme (FPTAS) for 
computing the partition function of a two-state spin system on an arbitrary graph, when the 
parameters of the system satisfy the uniqueness condition on infinite regular trees. This condi- 
tion is of physical significance and is believed to be the right boundary between approximablc 
and inapproximablc. 

The FPTAS is based on the correlation decay technique introduced by Bandyopadhyay and 
Gamarnik [SODA 06] and Weitz [STOC 06]. The classic correlation decay is defined with 
respect to graph distance. Although this definition has natural physical meanings, it does not 
directly support an FPTAS for systems on arbitrary graphs, because for graphs with unbounded 
degrees, the local computation that provides a desirable precision by correlation decay may take 
super-polynomial time. We introduce a notion of computationally efficient correlation decay, in 
which the correlation decay is measured in a refined metric instead of graph distance. We use 
a potential method to analyze the amortized behavior of this correlation decay and establish 
a correlation decay that guarantees an inverse-polynomial precision by polynomial-time local 
computation. This gives us an FPTAS for spin systems on arbitrary graphs. This new notion of 
correlation decay properly reflects the algorithmic aspect of the spin systems, and may be used 
for designing FPTAS for other counting problems. 



1 Introduction 



x 



Spin systems are well studied in Statistical Physics. We focus on two-state spin systems. An 
instance of a spin system is a graph G = (V,E). A configuration a : V — > {0, 1} assigns every 
vertex one of the two states. We shall refer the two states as blue and green. The contributions of 
local interactions between adjacent vertices are quantified by a matrix 



A 



where /3,7 > 0. The weight of an assignment is the production of contributions of all local in- 
teractions and the partition function Z\{G) of a system is the summation of the weights over all 
possible assignments. Formally, 
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Although originated from Statistical Physics, the spin system is also accepted in Computer Science 
as a framework for counting problems. Considering the two very well studied frameworks, the 
weighted Constraint Satisfaction Problems (#CSP) [6j0[TU[T2j[l31[T9j[26] an< ^ Graph Homomor- 
phisms [8HIT) | [T7 t l2"8 l l36] . the two-state spin systems can be viewed as the most basic setting in these 
frameworks: A Boolean #CSP problem with one symmetric binary relation; or Graph Homomor- 
phisms to graph with two vertices. Many natural combinatorial problems can be formulated as 
two-state spin systems. For example, with /3 = and 7 = 1, Za(G) is the number of independent 
sets (or vertex covers) of the graph G. 

Given a matrix A, it is a computational problem to compute Za(G) where graph G is given 
as input. We want to characterize the computational complexity of computing Za(G) in terms of 
j3 and 7. For exact computation of Za(G), polynomial time algorithms are known only for the 
very restricted settings that ^7 = 1 or 7) = (0,0), and for all other settings the problem is 
proved to be #P-Hard [8]. We consider the approximation of Za(G), with the fully polynomial- 
time approximation schemes (FPTAS) and its randomized relaxation the fully polynomial-time 
randomized approximation schemes (FPRAS). 

In a seminal paper [JH], Jerrum and Sinclair gave an FPRAS when (3 = 7 > 1, which was 
further extended to the entire region ^7 > 1 [41]. For < /3,7 < 1 except that (/3,7) = (0,0) 
or (1,1), Goldberg, Jerrum and Paterson prove that the problem do not admit an FPRAS unless 
NP=RP |41j . For the other values of the parameters, namely, 0</3<l<7<-gor symmetrically 
0<7<l</3<i, the approximability of Za(G) is not very well understood. It was shown 
in [5T] that by coupling a simple heat-bath random walk, there exists an additional region of f3 and 
7 which admit some FPRAS. The true characterization of approximability is still left open. 

Within this unknown region, there lies a critical curve with physical significance, called the 
uniqueness threshold. The phase transition of Gibbs measure occurs at this threshold curve. Such 
statistical physics phase transitions are believed to coincide with the transitions of computational 
complexity. However, there are only very few examples where the connection is rigorously proved. 
One example is the hardcore (counting independent set) model. It was conjectured in |56j by 
Mossel, Weitz and Wormald, and settled in a line of works by Dyer, Frieze and Jerrum [23], 
Weitz [61], Sly [58], and very recently Galanis, Ge, Stefankovic, Vigoda and Yang [31] that in 
the hardcore model the uniqueness threshold essentially characterizes the approximability of the 
partition function. It will be very interesting to observe the similar transition in spin systems. 

1.1 Main results 

We extend the approximable region (in terms of f3 and 7) of Za{G) to the uniqueness threshold 
in two-state spin systems, which is believed to be the right boundary between approximable and 
inapproximable. Specifically, we formulate a criterion for /3 and 7 such that there is a unique Gibbs 
measure on all infinite ree ulartree^ , and prove that there is an FPTAS for computing Za{G) when 
this uniqueness condition is satisfied. This improves the approximable boundary (dashed lines in 
Figure 1) provided by the heat-bath random walk in [H]. Moreover, the algorithm is deterministic. 

The FPTAS is based on the correlation decay technique first used in [HE] for approximate 
counting. We elaborate a bit on the ideas. A spin system induces a natural probability distribution 
over all configurations called the Gibbs measure where the probability of a configuration is propor- 

1 Technically, there is a small integrality gap caused by the continuous generalization of the condition. The formal 
statement is given in the following section. 
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Figure 1: Our FPTAS works for the region between the critical curve of the uniqueness threshold 
and the curve /?7 = 1 . The heat-bath random walk in [51] works for the region between the dashed 
line and /3-y = 1. 

tional to its weight. Due to a standard self-reduction procedure, computing Za(G) is reduced to 
computing the marginal distribution of the state of one vertex, which is made plausible by Weitz 
in [61] with the self-avoiding walk (SAW) tree construction. For efficiency of computation, the 
marginal distribution of a vertex is estimated using only a local neighborhood around the vertex. 
To justify the precision of the estimation, we show that far-away vertices have little influence on 
the marginal distribution. This is done by analyzing the rate with which the correlation between 
two vertices decays as they are far away from each other. 

The correlation decay by itself is a phenomenon of physical significance. One of our main 
discoveries is that two-state spin systems on any graphs have exponential correlation decay when 
the above uniqueness condition is satisfied. 

1.2 Technical contributions 

The technique of using correlation decay to design FPTAS for partition functions is developed in 
the hardcore model. We introduce several new ideas to adapt the challenges arising from spin 
systems. We believe these challenges are typical in counting problems, and the new ideas will make 
the correlation decay technique more applicable for approximate counting. 

1. The correlation decay technique used in [61] relies on a monotonicity property specific to 
the hardcore model. Correlation decays in graphs are reduced via this monotonicity to the 
decays in infinite regular trees, while the later have solvable phase transition thresholds. It 
was already observed in [61] that such monotonicity may not generally hold for other models. 
Indeed, it does not hold for spin systems. We develop a more general method which does not 
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rely on monotonicity: We directly compute the correlation decay in arbitrary trees (and as 
a result in arbitrary graphs via the SAW tree reduction), and use the potential method to 
analyze the amortized behavior of correlation decay. 

2. To have an FPTAS, the marginal distribution of a single vertex should be approximable up to 
certain precision from a local neighborhood of polynomial size. The classic correlation decay 
is measured with respect to graph distance. The local neighborhoods in this sense are balls 
in the graph metric. A SAW tree enumerates all paths originating from a vertex. For graphs 
of unbounded degrees, the SAW tree transformation may have the balls offering desirable 
precisions explode to super-polynomial sizes. 

We introduce the notion of computationally efficient correlation decay. Correlation decay 
is now measured in a refined metric, which has the advantage that a desirable precision is 
achievable by a ball (in the new metric) of polynomial size even after the SAW tree transfor- 
mation. We prove an exponential correlation decay in this new metric when the uniqueness 
is satisfied. As a result, we have an FPTAS for arbitrary graphs as long as the uniqueness 
condition holds. 



1.3 Related works 

The approximation for partition function has been extensively studied with both positive [181129} 
ESUHlllHlEOlEn] and negative results [31E1II31I321E31E71E81IS]. Some special problems in these 
framework are well studied combinatorial problems, e.g. counting independent sets [23,29,53j and 
graph coloring [HI201422 , 30 . 40 . 43T H7l[54t [55 t l60] . Some dichotomies (or trichotomies) of complexity 
for approximate counting CSP were also obtained |24 |, l2T| .f3TTl58J . Almost all known approximation 
counting algorithms are based on random sampling [25^151] . usually through the famous Markov 
Chain Monte Carlo (MCMC) method [161149] . There are very few deterministic approximation 
algorithms for any counting problems. Some notable examples include [Tl 2 , 34 , 42|l59j . 

In a very recent work [57], Sinclair, Srivastava, and Thurley give an FPTAS using correlation 
decay for the two-state spin systems on bounded degree graphs. They allow the two-state spin 
systems to have an external field, and the uniqueness thresholds they used are defined with respect 
to specific maximum degrees. 



2 Definitions and Statements of Results 



A spin system is described by a graph G = (V, E). A configuration of the system is one of the 2\ y \ 
possible assignments a : V — > {0, 1} of states to vertices. We also use two colors blue and green to 

where /3, 7 > 0. The Gibbs measure is a 
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The normalization factor Za(G) = J2ae2 v T\(uv)eE ^(u),a(v) ^ s called the partition function. 

From this distribution, we can define the marginal probability p v of v to be colored blue. Let 
o"A be a configuration defined on vertices in A C V. We call vertices v E A fixed vertices, and v A 
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free vertices. We use p% A to denote the marginal probability of v to be colored blue conditioned on 
the configuration of A being fixed as <ta- 

Definition 1 A spin system on a family of graphs is said to have exponential correlation decay if 
for any graph G = (V, E) in the family, any v £ V, A C V and o~a,t\ 6 {0, 



where A C A is the subset on which oa and ta differ, and dist(u, A) is the shortest distance from 
v to any vertex in A. 

This definition is equivalent to the "strong spatial mixing" in [61] with an exponential rate. It 
is stronger than the standard notion of exponential correlation decay in Statistical Physics [15] . 
where the decay is measured with respect to dist(u,A) instead of dist(u, A). 

The marginal probability in a tree can be computed by the following recursion. Let T be 
a tree rooted by v. We denote R^ A as the ratio of the probabilities that root v is blue and green, 

CT A 

respectively, when imposing the condition a a- Formally, i?^ A = Pv j a (whenp^ A = 1, let R% A = oo 

by convention). Suppose that the root of T has d children. Let Tj be the subtree rooted by the 
2-th child of the root. The distributions on distinct subtrees are independent. A calculation then 
gives that 



measures on infinite graphs. We say that the system has the uniqueness if there is exact one Gibbs 



For a fixed < /3 < 1, the T(/3) gives the boundary that all infinite regular trees T d exhibit 
uniqueness when < 7 < J. We call T(/3) the uniqueness threshold. Indeed, for any d > 1, 

there is a critical r^(/3) such that T d exhibits uniqueness when r^(/3) < 7 < -s. Furthermore, there 

is a finite crucial D > 1 such that Td((3) = T(/3). That is, T D has the highest uniqueness threshold 
r(/3) among all T d . 

We remark that for technical reasons, we treat d as real numbers thus T(f3) is slightly greater 
than the one defined by integer ds. An integer version of T(/3) is given in Section^ where a slightly 
improved and tight analysis is given for the specially case (3 = 0. 

Definition 2 A fully polynomial-time approximation scheme (FPTAS) for Za{G) is an algorithm 
that given as input an instance G and an e > 0, outputs a number Z in time poly(|G|, -) such that 



\pl K -pl K \ <exp(-0(dist(^,A))). 






(l-e)Z A (G) <Z<(l + e)Z A (G). 
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In Definition [H the correlation decay is measured in graph distance. In order to support an 
FPTAS for graphs with unbounded degrees, we need to define the following refined metric. 

Definition 3 Let T be a rooted tree and M > 2 be a constant. We define the M-based depth 
Lm(v) of a vertex v in T recursively as follows: Lhj(v) = if v is the root of T; and for every 
child u of v, if v has d > 1 children, Lm{u) = Lm(v) + \log M (d + 1)] . 

If every vertex in T has d < M children, Lm(v) is precisely the depth of v. If there are vertices 
having d > M children, we actually replace every such vertex and its d children with an M-ary 
tree of depth \log M (d + 1)] , and Lm(v) is the depth of v in this new tree. 

Definition 4 Let T be a rooted tree and M > 2 be a constant. Let Bm(L) = {v € T \ Lm{v) < L}, 
called an M-based L-ball, be the set of vertices in T whose M-based depths are no greater than 
L; and let B* M (L), called an M-based L-closed-ball, be the set of vertices in Bm{L) and all their 
children in T . 

The main technical result of the paper is the following theorem which establishes an exponential 
correlation decay in the refined metric when the uniqueness condition holds. 

Theorem 5 (Computationally Efficient Correlation Decay) Let < /3 < 1, /3~/ < 1, and 

7 > r(/3). There exists a sufficiently large constant M which depends only on (3 and j, such 
that on an arbitrary tree T, for any two configurations cr\ and t\ which differ on A C A, if 
B* M (L) n A = then 

\Rt A -Rt A \< exp(-Q(£)). 

The name computationally efficient correlation decay is due to the fact that \B]\f(L)\ < M L 
in any tree, thus an exponential decay would imply a polynomial-size Bm(L) giving an inverse- 
polynomial precision. 

Theorem [5] has the following implications via Weitz's self-avoiding tree construction |61j . 

Theorem 6 Let < /3 < 1, /?7 < 1 , 7 > T(/3). It is of exponential correlation decay for the Gibbs 
measure on any graph. 

Theorem 7 Let 0</3<l, ^7 < 1 , 7 > T(/3). There is an FPTAS for computing the partition 
function Za{G) for arbitrary graph G. 

By symmetry, in Theorem [5l O and [71 the roles of /3 and 7 can be switched. 
In the Section [31 we will show the FPTAS implied by Theorem EJ followed by a formal treatment 
of the uniqueness threshold in Section [H and finally the formal proof of Theorem [5] in Section [5l 

3 An FPTAS for the Partition Function 

Assuming that Theorem [5] is true, we show that when < (3 < 1 and T(/3) < 7 < 4, there 
is an FPTAS for the partition function Za{G) for arbitrary graph G. The FPTAS is based on 
approximation of R^, = Pv A /(l — Pv A )i the ratio between the probabilities that v is blue and 
green, respectively, when imposing the condition o~\. 
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The self-avoiding walk tree is introduced by Weitz in [61] for calculating Rq^ v - Given a graph 
G = (V,E), we fix an arbitrary order < of vertices. Originating from any vertex v £ V, a self- 
avoiding walk tree, denoted Tsaw(G, v), is constructed as follows. Every vertex in Tsaw(G, v) 
corresponds to one of the walks v\ — >■ v 2 —>■■■■—>■ in G such that ui = u, all edges are distinct 
and v±, . . . ,Vk-i are distinct, i.e. the self-avoiding walks originating from v and those appended 
with a vertex closing a cycle. The root of Tsaw(G, v) corresponds to the trivial walk v. The 
vertex v\ parents V2 in Tsaw(G, v), if and only if their respective walks w\ and W2 satisfy that 
W2 = w\ — > u for some u. For a leaf of TgAw(C, v) whose walk closes a cycle, supposed that the 
cycle is u — )• v\ —>■■■■ — >■ u, fix the leaf to be blue if f 1 > Vf. and green otherwise. When a 
configuration <ta is imposed on A C V of the original graph G, for any vertex of Tsaw(G, v) whose 
corresponding walk ends at a u 6 A, the color of the vertex is fixed to be o~\(u). We abuse the 
notation and denote the resulting configuration on Tsaw(G, v) by a a as well. 

This novel tree construction has the advantage that the probabilities are exactly the same in 
both the original spin system and the constructed tree. 

Theorem 8 (Weitz [61]) LetT = T SAW (G,v). It holds that R^ v = R a T h 

Due to dl]), in a tree T, the following recursion holds for 

1=1 J i 

The base case is either when the current root v £ A, i.e. v 's color is fixed, in which case i?^, A = 00 
or R^ A = (depending on whether v is fixed to be blue or green), or when v is free and has no 
children, in which case R^ A = 1 (this is consistent with the recursion since the outcome of an empty 
product is 1 by convention). 

For /?7 < 1, the recursion is monotonically decreasing with respect to every R^ A . An upper 
(lower) bound of i?^ A can be computed by replacing i?^ A in the recursion by their respective lower 
(upper) bounds. Algorithm [1] computes the lower or upper bound of R^ A up to vertices in M-based 
L-closed ball B* M {L). For the vertices outside B* M (L), it uses the trivial bounds < R < 00. 

Due to the monotonicity of the recursion, it holds that 

iZC^CTA^C^true) < R^ A < R(T, a A , L, 0, false). 

Note that the naive lower bound (or the upper bound 00) of R for a vertex outside B* M (L) can 
be achieved by fixing the vertex to be green (or blue). Denote by tq and t\ the configurations 
achieving the lower and upper bounds respectively. It is easy to see that tq = t\ = a\ in B* M (L). 
Then due to Theorem [5j there is a constant a < 1 such that 

\R(T, cja, L, 0, false) - R(T, a A , L, 0, true)| 

l Rrp Rrp J 

= 0(a L ). 

To compute Rq l v for an arbitrary graph G, we first construct the B* M (L) of T = Tsaw(G,v), 
and run Algorithm [TJ Due to Theorem [U Rq" v = Rt A 1 thus it returns Rq and R\ such that 

Ro < Rq A v < Ri and Ri - R = 0(a L ). Since K A = R^v/i 1 + R< g,v)i we can output p = 
and pi = so that p < p° A < Pl and Pl - p = _ < ^ - R = 0{a L ). 
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Algorithm 1: Estimate i?^ A based on B^j(L) 



R\T V , 0a, L, c? parent , lb): 

Input: Rooted tree T v ; configuration a a] M-based depth L; parent degree d parent ; Boolean 

indicator lb of lower bound. 
Output: Lower (or upper) bound of R^ A computed from vertices in B* M {L). 
begin 

Suppose root v has d children and let Tj be the subtree rooted by the i-th child; 
if v € A then 

if cr\(v) = blue then return oo; 
else return 0; 
else if L < then 

if lb = true then return 0; 
else return oo; 
else 

L' < — L- [log M ((ip aren t + l)] ; 

rPturn U d PRWua^L' ,d,-4b)+l , 



The running time of this algorithm relies on the size of B^(L) in Tsaw(G, v). The maximum 
degree of Tsaw(G, v) is bounded by the maximum degree of G, which is trivially bounded by n, 
thus \B%j(L)\ < n\B M (L)\ < nM L . The running time of the algorithm is 0(\B* M (L)\) = 0(nM L ). 

By setting L = log Q e, we can approximate 1 — p° A within absolute error 0(e) in time 0(n ■ 
poly(|)). For /3 < 1 < 7, it holds that < R^ v < 1 for free v thus 1 — p% A > \, therefore the above 
procedure approximates (1 — p% A ) within factor (1 ± 0(e)). We have an FPTAS for (1 — p% A ). 

The partition function Za{G) can be computed fromp^ A by the following standard routine. Let 
vi, . . . ,v n enumerate the vertices in G, and let Oi,i = 0,1, ... ,n, be the configurations fixing the 
first i vertices v±, . . . ,V{ to be green, where <7o means all vertices are free. The probability measure 
of a n (all green) can be computed as 

n 

M°n) = JJ Pr[^i is green | v\, . . . , V{-\ are green] 



i=l 



i=i 



On the other hand, it is easy to see that fJ>(cr n ) = z A (G) definition of fi. Thus 

Z A (G) 



Notice that 7^ > 1. Therefore, an FPTAS for (1 - p° A ) implies an FPTAS for Z A (G). 
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4 The uniqueness threshold 

In this section, we formally define the uniqueness threshold T(/3) and the critical D. We also prove 
several propositions regarding these quantities which are useful for the analysis of the correlation 
decay. 

Definition 9 Let < /3 < 1 be a fixed parameter. Suppose that 1 < 7 < ^ and d > 1. Let 2(7, d) 
be the positive solution of 



Define that /(x) = ( ^} ) . Then x(~/,d) is the positive fixed point of f(x). For 7 < 4, /(x) 



x + 7 

(/J + ^ is continuous and strictly decreasing over * £ [0,oc), and it holds that /(0) = ^ > 

and /(l) = f xip0 < ~3 < 1) thus /(x) has a unique fixed point over x 6 (0, 1). Therefore, for 
1 < 7 < 4 and d > 1, x(j,d) is well defined and x(j,d) G (0, 1). 

Definition 10 Lei 

w>1 rf(l-/? 7 )(/M7,ci) + l)^ 1 ^ 
" ' (x( 7 ,d)+ 7 ) d+1 



r(/3) = inf 1 7 > 1 
W^e write T = T(/3) for short if no ambiguity is caused 



Note that F can be equivalently defined as 
T = inf { 7 > 1 



W>1 djl-^x^d) 

" ' (/3x( 7 ,d) + l)(x(7,d)+7) " 

because x{^,d) satisfies ([2]). 

The following lemma states that for < /3 < 1, T(/3) is well-defined and nontrivial. 

Lemma 11 For < (3 < 1, ii holds that 1 < r(/3) < I. 

Proof: We first show that T > 1. It is sufficient to show that if 7 < 1 then there exists a d such 
th & t tr^tw^t. \ > 1) where x satisfies that x - 



By contradiction, suppose that 7 < 1 and for all d > 1, r^^w^jp^ < 1 where x satisfies that 
Then, 

t> d(l-/3 7 )x = rf(l-/3 7 ) > d(l-/?7) 



(/3x + l)(x + 7 ) /3x + ^ + (l + /3 7 ) " /3x + ^ + 2" 
Specifically, suppose that d is sufficiently large so the followings hold 

^exp ( d - < d{1 ~ M ~ 3 and 

/ 7d \ 7 
ex P -37^ o > 



d(l - /3 7 ) - 3 J d(l - £7) 
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Case.l: x > 7. Then - < 1. Thus, 



which implies that x > — ^ 3 , On the other hand 



d(l-/3 7 ) > d{\-M) 
~ (3X + 1 + 2- /3x + 3 ' 

O- 3 r 

3 



1 + 7 / \ x y \ d(l — ^7) — 3 



a contradiction. 
Case. 2: x < 7. Then /3x < ^7 < 1. Thus, 



d(l-/3 7 ) > ^(1-/37) 
-/3x + 2 + 2- 2 + 3 ' 

d(l-/3 7 )-3- r 



which implies that x < \_ 3 - On the other hand 



x + 7 7 -(x + l) d_ V d(l-/37)-3 

. ( id \ 7 
> exp "JT-i > 



d(l-Pi)-$) d(l-/?7)-3' 



a contradiction. 



We proceed to show that T < -|. It is sufficient to show that there exists a 1 < 7 < -| such that 
for all cZ > 1, /a^lTw 7 ^ \ < 1 5 where x satisfies that x = ( P x + l 
If /3 = 0, then x = < Thus, 

g£ = ^ = < < 4 < — , 

(/3x + l)(x + 7) x + 7 7" ehi7 

where the last inequality can be verified by taking the maximum of over d. Therefore, setting 

_ p i ;+ holds that d 0--^) x < _J_ _ 1 
7 - ee, n noiob max ^pjy^p^ v eln7 - 1. 

On the other hand, if < /3 < 1, choosing an arbitrary constant a £ (exp(— i^), 1) which also 

satisfies that a G (/?, 1), and assuming 7 £ 1 ~^ a ~^ ; ^ c (1, 1), we have 

el 



Thus, 



x+7/ V x+7 



d(1 " < d(l - fr)x < (1 - £7)^ < (1 " h) 



(/?x + l)(x + 7) — elna 
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where the last inequality is also proved by taking the maximum of da d . Therefore, we can choose 
i-(a-/3) ^ i _ e \n(i/a) j ^ ixicieecl satisifes 7 G (1, to guarantee that (^^.7)^1+7) — 



7 = max 



— elna — 



Therefore, for < /3 < 1, there always exists a 1 < 7 < ^ such that for all d > 1, it holds that 
t+7)fo+ 7 ) < where « satisfies that x = (^p^)^- This implies r < j. I 



Definitions 12 Let 7(d) &e i/ie solution 7 0/ 

d(l-/3 7 )x( 7 ,d) 



(/?x( 7 ,d) + l)(x(7,d)+ 7 ) 
ewer 7 G (1, -^), and define 7(d) = 1 by convention if such solution does not exist. 



(3) 



The following lemma states that 7(d) is well-defined and captures the uniqueness threshold for 
different instances of d. 

Lemma 13 The followings hold for 7(d): 

1. 7(d) is a well-defined function for d > 1. 

2. T = sup d>l7 (d). 



5. There exists a finite constant D > 1 suc/i £/ia£ T = j(D), and D is a stationary point 0/7(0?), 
= 0. 



d 7 



Proof: 



1. We first show that for any d > 1, there exists at most one 7 G (1, -j) satisfying ([3]), which will 
imply that 7(0!) is well-defined. 

Observe that for any fixed d > 1, x(7,d) is strictly decreasing with respect to 7 over 7 € 
(1, -j). By contradiction, assume that for some d > 1, x is non-decreasing over 7. Then 

x = ^ ^f^ 1 ^ = + ^q^^ is strictly decreasing over 7, a contradiction. 

Therefore, x ^7i)+7 mus t be strictly decreasing with respect to 7, or otherwise x = (^f3 + ^p^- 
would have been non-decreasing, contradicting that 2(7, d) is strictly decreasing. 
Combining these together, we have 



d(l-/3 7 )x( 7 ,d) d(l-M) 



G8s(7,d) + l)(x(7,d)+7) z( 7 ,d)+ 7 /S + ^ 

is strictly decreasing over 7 G (1, Thus, there exists at most one 7 G (1, ^) satisfying 
Therefore, 7(d) is well-defined. 
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2. We then show that T = sup rf>1 7(d). For any d > 1, let 



T d {p) = inf 7 > 1 



< 1 



Note that for any d > 1, when 7 -> i, ^ x ^ d) ^)^% +ry) ->■ < 1, thus r d (/3) < ±. In 
addition to that, since ^ ^ ^+ 7)^ (^) +7 ) is strictly decreasing over 7 G (1, T d (/3) is either 

equal to the unique solution 7 of (ff a ( 7 ^^7)fo(7d)+7) = ^ over ^ ^ j?) or ec l ua l *° 1 ^ such 
solution does not exist. Therefore, 

r d (/3) = 7 (d). 

Since ^ x ^ d )+i)(}^ d d ] +1 ) is strictl y decreasing over 7 G (1, ±), for any 7 G (1, ±) that 7 > 
r d (/3) for all d > 1, it holds that ^-^^^^ < 1 for all d > 1, i.e. 7 > r(/3). Thus, 
T(/3) < sup d>1 r^(/3). The other direction > sup rf>1 T d (f3) is universal. Therefore, 

= sup T d ({3) = sup 7 (d). 

<£>1 <£>1 

3. We show that there is a finite D > 1 that 7(D) = sup d>1 7(d). 

First notice that D > 1. By contradiction assume that D = 1. Substituting x in (1 — /?7)x = 

(J3x+l)(x+j) with the positive solution of x = ^^p^ gives us a 7 < 1. Then by conventional 

definition, 7(D) = 1. From the previous analysis, we know that 7(D) = sup d>1 7(d) = T and 
due to Lemma [TTT T > 1. A contradiction. 

We treat x = x("f(d),d) as a single- variate function of d. We claim that x — > as d — > 00. By 
contradiction, if x is bounded away from by a constant as d — > 00, then x = ( [3 + ^p^- J < 



f/3 + ^44) — )■ as d — )■ 00, a contradiction. 



Therefore, when d — )■ 00, it must hold that 7(d) > 1, because if otherwise 7 < 1, since x — > 

as d — > 00, it holds that x = ^^p^ — > which approaches either 1 or 00 as d — > 00, 
which contradicts that x — >• as d — >• 00. 

We just show that 7(d) > 1 for sufficiently large d, which means that for these ds, 7(d) is 
defined by (|3|) instead of defined by the convention 7(d) = 1. Thus, for sufficiently large d, 
x = x(7(d), d) and 7 = 7(d) can be treated as single- variate functions of d satisfying both ([2]) 
and ©. 

2+1 \" ^ 1 



For /?7 < 1, it holds that x = ( ) < ^, thus 



^ > ^ (1 7 / 7) > d(l - Pi)x = {fix + l)(x + 7) > 7, 



where the equality holds by ([3]). Thus, 7(d) < d d +! , 
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Recall that j(d) > 1 for all sufficiently large d, thus there is a finite d such that 7(d) is 

1 

bounded from below by a constant greater than 1. On the other hand, j(d) < d d +^ = 1 as 
d — > 00. Therefore, there is a finite D such that "f(D) = sup d>1 j(d). Due to Lemma [T3"l this 
implies j(D) = T. 

Since 7(-D) = sup d>1 ~/(d) and -D is neither infinite nor equal to 1, D must be a stationary 



point of 7(d), i.e. ^ 



= 0. 

d=D 



We can then define the crucial D which generates the highest uniqueness threshold T. 
Definition 14 Let D be the value satisfying "f(D) = T. Let X = x(T,D). 

It is obvious that both ([2]) and ([3]) hold for 7 = T, d = D, and x = X. Two less obvious but very 
useful identities are given in the following lemma. 

Lemma 15 The fallowings hold far T, D and X . 
r - D + 1 , 
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PX + 1\ 2(/3X + l) 2D(l-pT)X 



X + T J (D + l)(fiX + l)-2D (fiX + 1)(2DX - (D + 1)(X + T)) ' 
Proof: 

1. Since 7 = T, d = D, and x = X satisfies ([3]), it holds that 

D(l - 0T) = {fiX + l) ^ X + V) = hx + ^J +/3T + l>2y^T + /3T + l= (l + /sr) 2 , 
where the inequality is due to the inequality of arithmetic and geometric means. Thus, 



D > Therefore, 
1— VP 1 



where the last inequality is implied trivially by that < (3 < 1 and T > 1. 

2. Recall that X = x(T,D) and T = j(D), where x(^,d) is defined by ([2]), and 7(d) is defined 
by ([3]). Thus, x = x('j(d),d) and 7 = 7(d) can be treated as single-variate functions of d 
satisfying both (jJJ) and ([3]). 

The following identity is implied by (|3|): 

d{\- P 1 )x = (Px + l){x + 1 ). (4) 
Taking the derivatives with respect to d at d = D for both sides of (j3|), we have 

= {i-M)Ad=D- 



(fi(x + 7) + {fix + 1) - d(l - /3 7 ))^ + (fix(d + 1) + 1)^ 



d=D 



13 



Due to Lemma [131 it holds that ^ 



0. Then 



d=D 



dx 
dd 



(1 - pv)x 



__ D P(X + T) + (PX + 1)-D(1-/3T) 

(i - pr)x 2 

~ J{x + Tjx + (/3 x + rjx - (px + i)(x + r) 

(1 - (3T)X 2 



(applying @) 



px 2 -r ' 

Recall that x(j,d) is defined by (J2j) . Applying logarithm to both side of (|2J), we have 

'/3x + 1' 



lnx = <iln 



x + 7 



Taking the partial derivatives with respect to d for both sides, 



1 dx 
x dd 



In 



px + 1 



+ 



fid 



dx 



d 



dx 



x + 7 / (P x + 1) dd (x + 7) cW 



which implies that 

q x x(/3x + l)(x + 7) In ^ 



x+7 



(/3x + l)(x + 7) + (i(l-/37)x 
x(/3* + 1)(* + 7) In (/|±I 

(#c + + 7) + Jfix + l)(x + 7) 



(applying (0D) 



In 



ftg + 1 
x + 7 



Due to the total derivative formula, and that - 



dd 



d=D 



dx 
dd 



dx(j,d) dj(d) 



dd 



d=D 5 7 
Combining with ([5]), we have 



+ 



dx(-y, d) 



d=D 



hi 



dd 



+ 



<9x(7, d) 



d=D 



dd 



d=D 



£10 

2 



ffX + 1 



£X" + 1\ 2(l-/3r)X 



x + r y /3x 2 - r 

The equations in the lemma are consequences of the above equation. Specifically, 
2(1 -(3T)X 2D(1-(3T)X 



(3X 2 



D(/3X -l)(X + T) + D(l - PT)X 

2(PX + \)(X + T) 

D(f3X -i)(x + T) + (f3X + l)(X + T) 

2(f3X + 1) 
(D + 1)((3X + 1) - 2D' 



(applying <$)) 
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and 



2(l-pT)X _ 2D(1-(3T)X 

1 - pr)x 

Y 

(applying g])) 



(3x 2 -r D(/3X + i){x -r) - d(i- pr)x 

2D(l - (3T)X 



D(PX + 1)(X - r) - (px + l)(X + T) 
2D(1 -0T)X 

{px + pi - (p + i)(x + r)) ' 



5 Computationally Efficient Correlation Decay 

We prove Theorem [5j justifying the computationally efficient correlation decay. 

We use R v and R v + 5 V to respectively denote the lower and upper bounds of R^ A where T is 
rooted by v. For fixed vertices v € B* M (L), set R v = oo if v is blue (and = if v is green) and 
5 = 0. For all free vertices v £ B* M (L), supposed that v has d\ children fixed to be blue, do children 
fixed to be green, and d free children vi, . . . ,Vd, the recursion ([1]) gives that 

And for all vertices t> B* M (L), we use the naive bounds that R v — and 5 V — oo. 

Since 7>T>l>/3>0, the range of the recursion is (0, 1] as long as the inputs are positive. 
Thus for all free vertices v E B^(L), it holds that < R v < R v + 5 V < 1. 

Due to the monotonicity of the recursion, denoted by r the root of the tree, R r and R r + 6 r 
are lower and upper bounds respectively for all RJ^ where ta = cr\ in B* M (L). Theorem [5] is then 
implied by that 5 r < exp(— f2(L)). 

Let f(x\, . . . , Xd) = ^ Y\t=i IT+t"' Then the recursions © can be written as that R v + 5 V = 
f(R Vl , ■ ■ ■ ,R Vd ) and R v = f(R Vl +S Vl , . . . ,R Vd +S Vd ). Due to the Mean Value Theorem, there exist 
Ri £ [R Vi ,R Vi + S Vi ], 1 < i < d, such that 

S v = f(Rvi , Rv d ) — f\Rvi +8 Vl ,..., R Vd + S Vd ) 
= -Vf(R 1 ,...,R d )-(5 Vl ,...,5 Vd ) 



-(l-/? 7 ) H 



A straightforward estimation gives that 

TFT — "T^V 1 ~~ ^7) ' M N 



i=i ^ + 7 S(/9i2i + l)(i2i + 7) 



If this ratio is bounded by a constant less than 1, then the gap 5 shrinks by a constant factor for 
each step of recursion, thus an exponential decay would have been established. However, such a 
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step- wise guarantee of decay holds in general only when the 7 is substantially greater than T((3). A 
simulation shows that when 7 is sufficiently close to T(/3), the gap 5 may indeed increase for some 
specific d and Ri. We then apply an amortized analysis to show that even though the gap 5 may 
occasionally increase, it decays exponentially in a long run. 



5.1 Amortized analysis of correlation decay 

We use the potential method to analyze the amortized behavior of correlation decay. The potential 
function is defined as 

<S>(R) = R I £r(f3R + 1), 

where D is the crucial d which generates the highest uniqueness threshold as formally defined in 
Section H] 

We will analyze the decay rate of ^ instead of 5. This is done by introducing a monotone function 
ip{R), which is implicitly defined by its derivative cp'(R) = $^y- We denote that y v = <p(R v ) and 
Uv + e v = Lp(R v + 5 V ). Recall that R v + 5 V = f(R Vl ,. . . ,R Vd ) and R v = f(R Vl + 6 Vl , . . . , R Vd + 5 Vd ) 
where f(x 1 ,...,x d ) = ^± ]J d =1 fe±i. Then 

Uv = p(Rv) 

= tp(f(R Vl +5 Vl ,...,R Vd + 5 Vd )) 
= ^{fi^iVv! +e vl ),...,ip~ 1 {y Vd + e Vd ))) ; and 
Uv + e v = ip(Rv + 5 V ) 

= <p(f(R Vl ,...,R Vd )) 

= f • • • ^~ l {Vv d ))) ■ 

By the Mean Value Theorem, there exists an R £ [R V ,R V + 5 V ] such that 

e v = ip(R v + 5 V ) - tp(R v ) = 5 V ■ ip'(R) = -^U (7) 

By the Mean Value Theorem, there exist Ri £ [R Vi , Rvi + S Vi ], 1 < i < d, such that 

£v = vifiRv!,-- -,Rv d )) - <p{f(R Vl +5 Vl ,.. .,R Vd + S Vd )) 
= -V<p (f{R 1 ,...,R d )) ■(S Vl ,...,S Vd ) 



D-l 

d 



d , , 

< Wn=T> (8) 



1 



where (JSj) is trivially implied by that Ri £ (0, 1], 7 > 1 and /?7 < 1. By the Mean Value Theorem, 
there exist yi G y Wj +e Vi ] and due to the monotonicity of <£>(•), corresponding Ri G [R Vi , R Vi +5 Vi ] 
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that yi = ip(Ri), 1 < i < d, such that 



v{f{<p 1 (yi), ■■■,¥> 1 (yd))) - <p{f{<p 1 (yi + e 1 ),...,(p 1 {yd + ^d))) 
-v<p (/(^(yi), v-\m))) ■ (ei, . . . , e d ) 



d 



D-l 



Since Ri G (0, 1], 7 > 1, and ^7 < 1, Q trivially implies that 



■D-l 
2D 



e v < max{e t ,J • d [[ < - 0-1 • max{e„J, (10) 

On the other hand, we know that (3 < i//3T < -^^j- (due to Lemma [TCI in Section It is easy 

D-l 

to verify that function X p x+1 is monotonically increasing when x < 1. Then the following is also 
implied by 0: 

e« < a(d\Ri,. . . ,R d ) • max{e„J. (11) 

l<i<d 

where the function a(d; x\, . . . , Xd) captures the amortized decay, defined as 



ai ^,... M =- , n r^7/ -e^ U2) 

Our goal is to upper bound the a(d; x\, . . . , Xd) assuming the uniqueness condition. A concave 
analysis reduces the upper bound to the symmetric cases that all Xj are equal. 

Lemma 16 Let < /3 < 1, 7 > T(/3), and /?7 < 1. Then for any d > 1 and any xi, . . . ,x d & (0, 1], 
there exists an x E (0, 1], suc/i i/iai a(d; xi, . . . , x^) is maximized when all Xj = x. 

Proof: We denote ?/« = ln( ^'^ 1 ), then Xj = - 7 and 

/5exp f XZiLi 2/i ) + 1 »=i i 5 ^? 

expf^Eti^ 
+ 1 



a{d; x l ,...,x d ) = — d — 2_> j^- 



p+i 

2D 
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D + l 



where f(y)= (±=§ -7) 2D (e« - /3). 
It holds that 



D + l 



ev - /3 J \ je y 



D+l 



where 



g(y, D) = e^(/3 7 - l) 2 - 2(1 - /3 7 )(e 2/ - /3)(1 - je y )D 

- (2/3 + 2/3 2 7 - e w (l + 10/3 7 + /3 2 7 2 ) + 6 7 e 2y (l + /3 7 ) - 4 7 e 3?/ )Z) 2 . 

The fact e y G (/3, -) implies that the sign of f"(y) is the same as that of g(y,D). In the follow, 
we show that g(y, D) is always negative. The coefficient of D in g(y) is obviously negative given 
that e y G (/3, -). Now we show that the coefficient of D 2 in g(y) is also negative. To show this, the 

condition e y G (/3, ^) is not sufficient. We substitute yi = ln( ^ c ^ y 1 ) back and recall that Xj G (0, 1), 
we have 

2/3 + 2/3 2 7 - e y (l + 10/37 + /3 2 7 2 ) + 6 7 e 2y (l + /3 7 ) - 4 7 e % 

= 7 1 11 • (7 2 - x 2 + 7(1 - /3 7 )x + 3 7 x + 4/3 7 x 2 + /3x 3 ) > 0. 
(7 + x) s 

Since both the coefficients of D and D 2 are negative, we can choose D = 1, in which case, 

f"(y) = -ie y < 0. 

Denote that y = \ Yli=i Vi- Due to the Jensen's Inequality, Yli=i f{Vi) — df(y). Therefore, 

exp(^Eti^) * 
a(d; x 1 ,...,x d ) = -. — ^ — '— ■ ^ f(yi) 

P exp (£»=i yi J + 1 i=i 

eX P I 2X> 

p exp (ofy) + 1 

Let x satisfy that y = ln(^p^), i.e. x = — 7. It is then easy to verify that x G (0, 1] since 
all Xi G (0,1] and yi = ln(^M) is monotone with respect to Xj. Therefore, xi, . . . , Xd) is 
maximized when all Xj = x G (0, 1]. I 

We then deal with the symmetric case. Let 

D + l d(D-l) 

d{l - /3 7 )x 2D (/3x + 1) 2D 

a(d, x) = a(a; x, . . . , x) - 
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Let f(x) = (j^pj-^J be the symmetric version of the recursion ([I]). Observe that a(d,x) = 

Hftx)) \ f'( x )\> wri ich is exactly the amortized decay ratio in the symmetric case. 

Recall the formal definitions of D and X in Definition O in Section |H Our main discovery is 
the following lemma which states that at the uniqueness threshold 7 = r(/3), the value of a(d, x) 
is maximized at d = D and x = X with a{D,X) = 1. It is in debt to the magic of the potential 
method to observe such a harmoniously beautiful coincidence between amortized correlation decay 
and phase transition of uniqueness. 

Lemma 17 Let < /? < 1 and 7 = T(/3). It holds that sup d>i a(d, x) = a(D,X) = 1. 

0<x<l 

Proof: It is not difficult to verify that a(D, X) = 1. Note that © and ^ hold for 7 = T, d = D 
and x = X. Then 



a(D,X) - 



n -D + l 

X \ I px + i 



(PX + 1)(X + T) 



D 



\ \ x+r ) J \ p \ 



+ 1 



0+1 



d(i - pr)x (x\ — fpx + i 



(fiX + 1){X + T)\XJ \PX + 1 

= 1. 

We then show that sup d>i a(d,x) = a(D,X). For the rest of the proof, we assume that 

0<a;<l 

< P < 1, d > 1, and < x < 1. Due to lemma [EH 1 < T(/3) < i. And we know that 
X = x(T,D) e (0,1). 

Denote that z = 
Ci = x _|T r x 2D > is independent of d. Thus, 



Denote that z = (^pr) • Then a(d, x) can be rewritten as a(d, x) = C\ ■ (J z+1 ) ; where 



da(d,x) C\z 2D 



dd 2D (f3z + 1) 
where the function g(z) is defined as 

g(z) = 2D((3z + l) - ((£> + l)(/3z + 1) - 2D)\nz. 



It is obvious that ^| 2U ,t > 0, thus the sign of da ^ x ) - ls governed by q(z). Note that < z 

2D(/3z+l) ' dd ° 

(i^)"<l- Then 

d ^ Z ) --((D- + 1) - (D + l)pzlnz) > (D - \){fiz + 1) > 



dz 

x+r 



Therefore, g(z) is strictly increasing with respect to z. Due to Lemma [T5l it holds that In ' H— +1 



2 (^+!) Thus 

1)(BX+1)-2D ■ lnub ' 



(D+1)(/3X+1) 

= 2D {fiX + 1) - D ((D + 1)(/3X + 1) - 2D) In f ) 
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Therefore, da ^^ < when z < X; 9a ^J x ^ = when z = X; and da ^ x ^ > when z > X. 



Note that z = (^TTT") ^ s rnonotonically decreasing with respect to d since ^ ^p 1 ^ < ^ < 1. Let 

ln(^x+l)-ln(x+r) ' 



P( X ) = \n(8x+l)-ln(x+D ■ lt is then eaS y to Veri fy tllat 



da(d, x) 
dd~ 



<0 if d>p(x), 
= if d = p(x), 
> if d < p(x). 



Therefore, for any d and x, a(d,x) < a(p(x),x). 

D+l D i i d 

Recall that a(d, x) = ^r^ ffef^ where z = (f^) . When d = p{x) = ln( ,, + ^ n(x+rr 
it holds that z = (jjj$f\ = X. Therefore, 



D + l 
X 2D 

a(p(x), x) = C 2 ■ 



(x + T)(\n(px + 1) - ln(x + V)) ' 

InX . . A A 



where C2 = ^ ^bx+u ^ X 1S independent of x, and C2 < since < X < 1. 



da(p(x),x) _ C2X 2D • h(x) 



dx 2 ,D(x + r) 2 (/5x + l)(ln(^±i NN 



where 

'Px + 1 



h(x) = 2D(1 - pr)x - (fix + l)(2Dx - (D + l)(x + Y)) ■ In 



x + r 



--D + 1 



= 0, which implies that for any x, 

x=X 



It is easy to see that C2X 2U , , a -p— 5 < and h(x) is monotonically increasing. Due 

to Lemma QU In = m +i)(^x-^+i)(x+T)) ■ thus M-*) = °- Therefore, d " ( g ) ' a:) is 

monotonically decreasing with respect to x and da ^ x 
a(p(x),x) < a(p(X),X). 

Due to ©, it holds that X = (^rpr) , thus p(X) = jjy^T\ = D, hence a(p(X),X) = 
a(-D,X). 

In conclusion, assuming < f3 < 1 and 7 = for any d > 1 and < x < 1, it holds that 

a(d,x) < a(p(x),x) < a(p(X),X) = a{D,X) = 1. 

I 

As a consequence of the above lemma, a strict upper bound is obtained as follows. 

Lemma 18 For < (3 < 1 and < 7 < i ; i/iere exists a constant a < 1 suc/i i/iat /or any 
d > 1 and < x < 1, /10/as i/iai a(d, x) < a. 
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Proof: Let ag-y = sup d>i a(d, x). Note that olr^ is a constant independent of d and x. And 

0<x <l 

ot/3 t r = 1 due to Lemma [T71 

We then show that ctp tl < otpp for T < 7 < In particular, we first show that for any d > 1 
and < x < 1, a(d, x) is strictly decreasing with respect to 7 over 7 G (T, -|). 



a(d, x) = C3 • 



n \ / \ d(D + l) 

1 — P7\ (X + 7) 2D 



1 + 7 / (/9(/3x + l) d + (x + 7 ) d ) ' 



where C3 = dx 20 (/3x + 1) 20 > is independent of 7. Let h(^y) 



d(D + l) , „ . , d(O-l) ( 3 , +7 )^Xr 



(^(^x+l) d + (x+ 7 ) d ) 



dh(j) _ d(£> + l)(x + 7 )^r 11 - 1 _ / / (3x + l \ _ D-l 

d7 ~ 2D (/?(/3x + l) d + (x + 7 ) rf ) 2 ' V + D + l 

d(3D + l) , 

d(L> + l)(x + 7)^13 1 f/3 D-l 



2D (p(J3x + l) d + (x + j) d ) 2 V r D + 1 
<0, 

where the second to the last inequality holds because x > and 7 > T, and the last inequality 
is due to Lemma [15j The fact that < implies that ^(7) is strictly decreasing. Thus, 



d7 

a(d,x) = C3 • ( • M7) 18 strictly decreasing with respect to 7 over 7 G (T, ^). 

Let a 7 (d, x) denote the a(d, x) with parameter 7. We can assume that there exist finite d* > 1 
and constant < x* < 1 achieving that a 7 (d*,x*) = sup d>i a 7 (d, x), since if otherwise it would 

0<a;<l 

hold that sup d>i a 7 (d, x) is achieved by either d — > 00 or x — > 0, but in either case it is easy to 

0<a;<l 

verify that a 7 (d, x) — > 0, thus a« 7 = sup a>i a 7 (d, x) = and we are done. Since a(d,x) is strict 

0<x<l 

decreasing with respect to 7, it holds that a 7 (d*,x*) < ar(d*,x*) for any 7 E (T, 4) Therefore, 



atflrf = sup aty(d, x) = a 7 (d*,x*) < ar(d*,x*) < sup ar(d,x) = app = 1. 



0<a:<l 0<:c<l 



I 

Combining Lemma[16]and Lemma [T8| we have the following lemma which bounds the amortized 
correlation decay when the uniqueness is satisfied. 

Lemma 19 Let a(d; x\, . . . , xj) be defined by (fT2|) , For < /3 < 1 and T(/3) < 7 < 4, there 
exists a constant a < 1 which depends only on (3 and 7, smc/i that for any d > 1 and x^ G (0, 1], 
i = 1, 2, . . . , d, it holds that a(d; x\, . . . , x^) < a 

The following lemma bounds the amortized correlation decay with respect to the refined metric 
of M-based depth. 

Lemma 20 Assume that < (3 < 1 and T(/3) < 7 < ^. There exist constants a < 1 and M > 1 
which depend only on {3 and 7, for every vertex v G B^f(L), assuming that v has do children fixed 
to be blue, d\ children fixed to be green, and d free children v\,... ,Vd, it holds that 

< Ma^ ogA{ ( do+dl+d+1 ^~ 1 ; (13) 



e v < a n°SM(do+di+d+i)-] . max | | _ n 4 ) 

Ki<d 
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Proof: We choose a to be the one in Lemma [T9l and M > 1 to satisfy 

k 



L < q P°Sm*1 for k > M. (15) 



Due to 



€v < < Mari°gM(do+rfi+d+i)l-i 



where the last inequality follows from (|15p if do + d± + d > M and the case do + d± + d < M is 



trivial since n-r < d < M. Thus (1131 ) is proved. 

^(d 0+dl +d)^ - i — " ^ 

Due to (JUJ), et, < a(d;i?i, . . . , i2rf)-maxi< i < (i {e 1 , i } where R Vi < Ri < R Vi +5 Vi . Since u € Bm(L), 
its children «j G B* A[ {L). As we discussed in the beginning of this section, < R Vi < R Vi +5 Vi < 1, 
thus Ri € (0, 1]. Then due to Lemma \19\ there is a constant a < 1, 

e„ < a(d; . . . , i?d) • max{e„J < a ■ max{e 1) J. (16) 

Ki<d Ki<d 



Thus, dUD holds trivially when d + d 1 + d < M. As for d + d 1 + d> M, due to (|T0j) . 

< Ta f jrn=i • maxK} < a no SM (d +d 1+ d+i)] . m&x { } 
^(<io+di+<i)^ t l<i<d 

Therefore, (fbi|) is proved. I 

Proof of Theorem [5], We prove by structural induction in Bm{L). The hypothesis is 

Vw e B M {L), e v < Ma L ~ LM ^- 1 . 

For the basis, we consider those vertices v £ Bm{L) whose children are in B* M {L) \ Bm(L). The 
fact that the children of v are not in Bm{L) implies that Lm(v) + [log j^- (do + di + d + 1)] > L, 
where do + d\ + d is the number of children of v. Then due to (|13|) of Lemma |2"UI 

e < Ma>^° SM ( do+dl+d+1 ^~ 1 < Ma L ~ LM ^~ 1 . 

The induction step is straightforward. For every child V{ of v, Lm(vi) = Lm{v) + [log M (do + d\ + 
d + 1)] . Suppose that the induction hypothesis is true for all Vi. Due to (|14p of Lemma [20] 

6. < a \ lo S M (do+di+d+l)] . max r | < a \log u (do+di+d+l)]+L-L u (vi)-l = a L-L M (v)-l 

The hypothesis is proved. 

Finally, for the root r of the tree, Lm{t) = 0, thus due to ([7]), there exists an R £ [R r , R r + S r ] C 
(0, 1] such that 

S r = $(R) ■ e r < R^ipR + 1) • Ma^W" 1 < 2Ma L ~ l . 
As we discussed in the beginning of this section, this implies Theorem [5l 
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6 A tight analysis for (3 = 



In this section, we give a slightly improved and tight analysis (since we also have a hardness result) 
of the algorithm when (3 = 0. In the definition of T((3), we take the maximum over all the possible 
real d > 1. As degrees of graphs, only those integer values have physical meanings and we also 
believe that the maximum value over all the integer d gives the right boundary between tractable 
and hard. In the following, we show how to extend our result to integral d for the special case of 

p = o. 

Recall that < /3 < 1, x satisfies x = 0§pf) ■ The inte ger version of T((3) can be formally 
defined as 



r(/3) = inf^ 7 >l Vd€ {1,2,3,...}, 1 Iw+i <1 



d(l -/3 7 )0 + l) d - 
(x + 7) c 



For (3 = 0, we can solve it and have that T*(0) = max^ 6 | 12 3j l)d d + 1 . It is easy to verify 

_ d 

that (d — l)d d +! is monotonously increasing when d < 11, decreasing when d > 12 and reaching 
the maximum when d = 11. Therefore T*(0) = 10 • 11~T2. 

We notice that T*(0) = 10 • 11~t! ps 1.1101714 and the continuous version T(0) « 1.1101715. 
The integrality gap is almost negligible, especially when compared to the previous best boundary 
for 7 when (3 = provided by the heat-bath random walk algorithm in [IT] , which is approximately 
1.32. 



Theorem 21 Let A 



1 

1 7 



where 7 > T*(0) = 10 • 11~ts . There is an FPTAS for Z A (G). 



Proof: The algorithm is exactly the same as the algorithm in Section [3l What we need is to 
establish a correlation decay. For this, we use a special potential function by substituting (3 = 
and D with D* = 11. Therefore the potential function is 

, > D*+l 6 

$(#) = R-2D*- = RTi. 

The analysis remain the same as before, except Lemma [T71 which is the only place assuming 
continuous d in the old analysis. We need to reprove Lemma [T7] for integral d. The symmetric 
amortized decay a(d, x) is now written as 

a (d,x) 



(a; + 7) 



1+— 

^ 11 



We are about to show that if 7 > r*(0), there is a constant a < 1 such that a*(d, x) < a < 1 for all 
< x < 1. Also by the strict monotonicity, we only need to prove (by substituting 7 with T*(0)) 

•(a \ dx ^ ^ 1 



(s + r*(o)) 



1+— 

t 11 



Take the partial derivative of a* over x, we have 

da* d 



dx 



llxTT(x + r*(0)) 2+ Ti 



■((5 + 5d)s-6r*(0)). 
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For a fixed d, when x < 6 § + ^J , a*(d,x) is monotonous increasing with x and when x > 6r ^ 

a*(d,x) is monotonous decreasing with x. So a*(d, x) reach its maximum when x 
stituting this into a*(d, x), we have 



5+5d ' 

6r*(o) n i 

-5+5T- Sub " 



a*(d, x) < a(d) 



1 6 5(l+d) 5 

2TT3IT11 - ia 
(ll + 5d)(10 + T ^)ff 



We can verify that is monotonously increasing when ci < 11 and decreasing when d > 12 and 
it reach its maximum when d = 11. The maximum is a(ll) = 1. This completes the proof. I 

For ft = 0, it is very related to the hardcore model. We can make use of the hardness result 
in [58] and |31j to get a tight hardness result as follows. 



Theorem 22 Let A 

unless NP = RP . 



1 

1 7 



, where 7 < T*(0) = 10 • II - 12. There is no FPRAS for Z A (G) 



Proof: The starting point is the hardness result for hardcore model in [58]. For hardcore model, 
the partition function is 

Z X (G) = £ Al*l 
sei(G) 

where the summation goes over all the independent set of G. For ft = 0, nonzero terms in the 
summation 

za(g) = n a*®,*® 

have a one-to-one corresponding with all the independent sets of G. The term indexed by a is 
nonzero iff cr _1 (0) is an independent set of G. So Za(G) can be rewritten as 

z A (g)= 1 \ e \ y: 

Se/(G) ves 

where d(v) is the degree of vertex v. If G is a cf-regular graph, this summation can be further 
rewritten as 

Za(G) = ^ £ (7-TI 
561(G) 

Since 7^ is a global factor which can be easily computed, the computation for Za(G) of (Z-regular 
graph G is equivalent to the partition function of the hardcore model on G with fugacity parameter 
7 _d . In [58] and |31j . it is proved that there is no FPRAS for the partition function for hardcore 
model on graphs with maximum degree d when the fugacity parameter A > (d-2) d umess NP=RP, 
when d > 6. If we can strength the hardness result to (i-regular graph, we can use the equivalence 
relation to get a hardness result for the the two-spin system model when (3 = and 7 > (d-2) d • 

Let d = 12, the inequality gives 7 < 10 • ll~i2 , as what we claimed. In the following, we show that 
their hardness proof for hardcore model indeed already works for d-regular graph. 

To prove the hardness of the hardcore model. A reduction from the max-cut problem to the 
hardcore partition function is built in [58] , The hard instance of the hardcore problem in their 
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reduction is almost d-regular except some vertices with degree d — 1. It can be easily verified in 
their gadget that if we are starting from a max-cut instant in a regular graph, we can choose the 
suitable parameter and build the reduction to a (i-regular instance in the hardcore model. So it 
remains to show that max-cut on a regular graph is already NP-hard. 

This can be done by a simple reduction from max-cut on arbitrary graph to a max-cut instance 
of a regular graph. Let G = (V, E) be a given max-cut instance. Let A be the maximum degree of 
G. Then the new instance is of 2A-regular. The new graph G' = (V , E') is defined as follows: 

• For every vertex v G V, we construct 1 + 2(A — d(v)) vertices in V' , we name them as v and 
vf, v~ for z = l,2,...,A — d{v). These are all the vertices in the new graph G' . 

• For every v £ V and «G{1,2,...,A - d(v)}, we connect 2 A — 1 edges in G' between vf and 
v~ , one edge between v and vf , and one edge between v and . 

• For every (u, v) G E be an edge of E, we connect two edges between u and ii in G'. 

It is easy to see that all the vertices in graph G' have degree 2 A. For a max-cut for G' , we will 
always put vf and v^ into different sides for every v G V and i G {1, 2, . . . , A — d(v). If not, one 
can improve the cut by moving one of them to the other side. Given that vf and v ~ are always 
in different sides, the contribution in the cut for the edges between vf and v^ , v and vf, v and 
v~ are all fixed. The remaining part is identical to the original graph except that we double every 
edge. This finishes the reduction and completes the proof. I 

7 Open Questions 

Our analysis of correlation decay assumes a continuous degree d because of the the using of differ- 
entiation. An open question is to improve the analysis to integral d and the uniqueness threshold 
realized by infinite (d+ l)-regular trees T d . It will be very interesting to prove a hardness result be- 
yond this threshold and observe the similar transition of computational complexity in spin systems 
as in the hardcore model [58] . 

In this paper, we consider the two-state spin systems without external fields. It will be inter- 
esting to extend our result to cases where there is an external field as in [3T]. Since the hardcore 
model can be expressed as a two-state spin system with an external field. This will give a unified 
theory covering the previous results for the hardcore model. 

Most importantly, it will be interesting to apply the general technique in this paper to design 
FPTAS for other counting problems. 
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